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The MAILING DATE of this communication appears on the cover sheet with the correspondence address- 

All claims being allowable, PROSECUTION ON THE MERITS IS (OR REMAINS) CLOSED in this application. If not included 
herewith (or previously mailed), a Notice of Allowance (PTOL-85) or other appropriate communication will be mailed in due course. THIS 
NOTICE OF ALLOWABILITY IS NOT A GRANT OF PATENT RIGHTS. This application is subject to withdrawal from issue at the initiative 
of the Office or upon petition by the applicant. See 37 CFR 1.313 and MPEP 1 308. 

1 • H This communication is responsive to August 09. 2004 . 

2. ^ The allowed claim(s) is/are 1-24 . 

3. ^ The drawings filed on 10 May 2001 are accepted by the Examiner. 

4. □ Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 

a) □ All b) □ Some* c) □ None of the: 

1. □ Certified copies of the priority documents have been received. 

2. □ Certified copies of the priority documents have been received in Application No. . 

3. □ Copies of the certified copies of the priority documents have been received in this national stage application from the 

International Bureau (PCT Rule 17.2(a)). 
* Certified copies not received: . 

Applicant has THREE MONTHS FROM THE "MAILING DATE" of this communication to file a reply complying with the requirements 
noted below. Failure to timely comply will result in ABANDONMENT of this application. 
THIS THREE-MONTH PERIOD IS NOT EXTENDABLE. 

5. □ A SUBSTITUTE OATH OR DECLARATION must be submitted. Note the attached EXAMINER'S AMENDMENT or NOTICE OF 

INFORMAL PATENT APPLICATION (PTO-152) which gives reason(s) why the oath or declaration is deficient. 

6. □ CORRECTED DRAWINGS ( as "replacement sheets") must be submitted. 

(a) □ including changes required by the Notice of Draftsperson's Patent Drawing Review ( PTO-948) attached 

1) □ hereto or 2) □ to Paper NoVMail Date . 

(b) □ including changes required by the attached Examiner's Amendment / Comment or in the Office action of 

Paper No./Mail Date . 

Identifying indicia such as the application number (see 37 CFR 1.84(c)) should be written on the drawings in the front (not the back) of 
each sheet. Replacement sheet(s) should be labeled as such in the header according to 37 CFR 1.121(d). 

7. □ DEPOSIT OF and/or INFORMATION about the deposit of BIOLOGICAL MATERIAL must be submitted. Note the 

attached Examiner's comment regarding REQUIREMENT FOR THE DEPOSIT OF BIOLOGICAL MATERIAL. 
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Examiner's Detailed Office Action 



1. Claims 1-24 are allowed. 

REASONS FOR ALLOWANCE 

2. The following is an Examiner's statement for reasons for allowance: 

3. The closest prior art Li et al (USPAP 2002/0161747 Al), Dimitrova et al (USPAP 
2002/0147782 Al), and Yao Wang, Zhu Liu, and Jin-Cheng Huang (hereinafter "Wang et a/.") 
"Multimedia Content Analysis" Using Both Audio and Video Vlues, IEEE Signal Processing 
Magazine, November 2000, does not teach or render obvious applicant's claimed invention. 

4. With regards to claim 1 Li et al, Dimitrova et al, & Wang et al, does not disclose 

" ...a combining process that creates a visual feature vector for each of the visual modalities and 
a textual feature vector for each of the textual modalities, and concatenates for each of the one 
or more multimedia items the visual feature vectors and the textual feature vectors into a unified 
feature vector" 
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5. With regards to claim 16 Li et al, Dimitrova et al, & Wang et al, does not disclose 

" ... a combining process that creates a visual feature vector for each of the visual modalities 
and a textual feature vector for each of the textual modalities, and concatenates for each of the 
blocks the visual feature vectors and the textual feature vectors into a unified feature vector, ... 
and a segmentation process that finds temporally contiguous groups of the blocks and combines 
the contiguous groups into media segments where all the blocks in the media segment have one 
or more of the same classes" 

6. With regards to claim 22 Li et al., Dimitrova et al, & Wang et al, does not disclose 

" ...creating a visual feature vector for each of the visual modalities and a textual feature vector 
for each of the textual modalities, for each block, concatenating the visual feature vectors and 
the textual feature vectors into a unified feature vector, categorizing each of the blocks by cate- 
gorizing the respective unified feature vector, and assembling two or more of the categorized 
blocks into a segment" 

7. With regards to claim 23 Li et al, Dimitrova et al, & Wang et al, does not disclose 

" ...creating a visual feature vector for each of the visual modalities and a textual feature vector 
for each of the textual modalities, for each block, concatenating the visual feature vectors and 
the textual feature vectors into a unified feature vector, categorizing each of the blocks by cate- 
gorizing the respective unified feature vector, and assembling two or more of the categorized 
blocks into a segment" 

8. With regards to claim 24 Li et al, Dimitrova et al, & Wang et al, does not disclose 
"... means for creating a visual feature vector for each of the visual modalities and a textual 
feature vector for each of the textual modalities, block by block, means for concatenating the 
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visual feature vectors and the textual feature vectors into a unified feature vector, block by block, 
means for categorizing each of the blocks by categorizing the respective to unified feature 
vector, and means for assembling two or more of the categorized blocks into a segment" 

Correspondence Information 

9. Any inquires concerning this communication or earlier communications from the 
examiner should be directed to Michael B. Holmes, who may be reached Monday through 
Friday, between 8:00 a.m. and 5:00 p.m. EST. or via telephone at (571) 272-3686 or facsimile 
transmission (571) 273-3686 or email Michael.holmesb@uspto.gov . 

If attempts to reach the examiner are unsuccessful the Examiner's Supervisor, 
Anthony Knight, may be reached at (571) 272-3687. 
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